Evaluating ChatGPT as a Bullshit Machine

The structure of the paper is as follows: in the first section, we outline how ChatGPT and similar LLMs operate. Next, we consider the view that when they make factual errors, they are lying or hallucinating: that is, deliberately uttering falsehoods, or blamelessly uttering them on the basis of misleading input information. We argue that neither of these ways of thinking are accurate, insofar as both lying and hallucinating require some concern with the truth of their statements, whereas LLM...

 Identifying AI Online

Before you continue, pause and consider: How would you prove you're not a language model generating predictive text? What special human tricks can you do that a language model can't? 1. Triangulate objective reality [...] This leaves us with some low-hanging fruit for humanness. We can tell richly detailed stories grounded in our specific contexts and cultures: place names, sensual descriptions, local knowledge, and, well the je ne sais quoi of being alive. Language models can decently mim...

 What are Observations?

What are observations? Some philosophers have taken them to be sensory events: the occurrence of smells, feels, noises, color patches. This way lies frustration. What we ordinarily notice and testify to are rather the objects and events out in the world. It is to these that our very language is geared, because language is a social institution, learned from other people who share the scene to which the words refer. Observation sentences, like theoretical sentences, are for the most part senten...

 The World and Beliefs

The world with its quarks and chromosomes, its distant lands and spiral nebulae, is like a vast computer in a black box, forever sealed except for its input and output registers. These we directly observe, and in the light of them we speculate on the structure of the machine, the universe. Thus it is that we think up the quarks and chromosomes, the distant lands and the nebulae; they would account for the observable data. When an observation turns out unexpectedly, we may try modifying our th...

 Border Crossings into Science Culture

Learning to communicate in and with a culture of science is a much broader undertaking than mastering a body of discrete conceptual or procedural knowledge. One observer, for example, describes the process of science education as one in which learners must engage in "border crossings" from their own everyday world culture into the subculture of science.^ The subculture of science is in part distinct from other cultural activities and in part a reflection of the cultural backgrounds of scienti...

 We Compile What We Read in the Context of When We Read It

Reading and experience train your model of the world. And even if you forget the experience or what you read, its effect on your model of the world persists. Your mind is like a compiled program you've lost the source of. It works, but you don't know why. [...] ...reading and experience are usually "compiled" at the time they happen, using the state of your brain at that time. The same book would get compiled differently at different points in your life. Which means it is very much worth re...

 Number Scrabble: Numerical Tic-Tac-Toe

In psychological research on problem-solving, sometimes the game of Tic-Tac-Toe is employed, which, though very simple to learn and play, still offers sufficient problems to the investigator in that it is not at all clear what heuristics are used by the subjects, except avoiding the winning move of the opponent. The same is apparently true for the isomorphic game of Number Scrabble, which is based on the fact that there exists a 3 X 3 magic square, of which rows, columns, and main diagonals a...

 Natural Selection Resembles Bayesian Inference

The analogy is mathematically precise, and fascinating. In rough terms, it says that the process of natural selection resembles the process of Bayesian inference. A population of organisms can be thought of as having various 'hypotheses' about how to survive—each hypothesis corresponding to a different allele. (Roughly, an allele is one of several alternative versions of a gene.) In each successive generation, the process of natural selection modifies the proportion of organisms having each...